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ABSTRACT 

A  two  node  tandem  queueing  system  with  phase-type  servers  and  Bernoulli  arrivals  is  consid¬ 
ered  in  discrete-time  when  servers  are  subject  to  blocking  and  failures.  The  invariant  probability 
vector  of  the  the  underlying  finite  state  Quasi-Birth-and-Death  process  is  shown  to  admit  a  matrix- 
geometric  representation  for  all  values  of  the  arrival  rate  A.  The  corresponding  rate  matrix  is  given 
explicitly  in  terms  of  the  model  parameters  and  the  resulting  closed-form  expression  provides  the 
basis  for  an  efficient  calculation  of  the  invariant  probability  vector.  The  cases  A  =  1  and  A  <  1 
are  studied  separately  and  the  irreducibilty  of  the  underlying  Markov  chain  is  discussed  for  each 
case.  The  continuous-time  formulation  is  briefly  discussed  and  only  major  differences  with  the 
discrete-time  results  are  pointed  out.  Some  numerical  examples  are  also  provided. 
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1.  INTRODUCTION 


Tandem  queueing  systems  with  finite  buffers  and  blocking  are  an  essential  modelling  compo¬ 
nent  of  many  manufacturing  facilities  and  communication  networks.  To  fix  the  ideas,  consider  a 
production  line  where  parts  sequentially  require  work  from  several  machines  in  a  specified  order. 
Each  machine  is  attended  by  a  finite  capacity  buffer  and  blocking  may  thus  occur.  This  blocking 
phenomenon  affects  the  performance  of  the  system  in  an  essential  way,  especially  when  the  various 
machines  are  subject  to  failures  or  to  various  other  interruptions ,  as  is  often  the  case  in  real  sys¬ 
tems.  Queueing  networks  with  blocking  have  been  studied  by  researchers  from  different  research 
communities,  and  are  typically  difficult  to  analyze.  To  date  strikingly  few  results  are  available, 
with  the  bulk  of  the  work  focusing  on  continuous-time  models.  A  brief  classification  of  the  blocking 
systems  discussed  in  the  literature  is  provided  in  [8],  where  an  annotated  bibliography  of  some  of 
these  papers  has  been  compiled. 

The  aim  of  this  paper  is  to  gain  understanding  of  the  blocking  phenomenon  through  the  study 
of  simple  models  for  which  easily  computable  analytical  results  can  be  obtained.  The  simple  model 
with  blocking  analyzed  here  is  the  two  node  tandem  queueing  system,  depicted  in  Figure  1.1, 
with  finite  capacity  intermediate  buffers.  Both  nodes  are  attended  by  single  servers  which  operate 
according  to  the  FCFS  (first-come-first-served)  queueing  discipline.  The  service  time  distributions 
at  each  node  are  phase  type  (PH).  Jobs  arrive  into  the  system  according  to  a  Bernoidli/ Poisson 
process  and  some  work  is  performed  on  a  job  at  the  first  node.  The  job  is  then  either  passed  on 
to  the  second  node  or  is  fed  back  to  the  first  buffer  with  a  certain  probability.  Upon  completion 
of  the  service  at  the  second  node,  the  job  is  either  fed  back  to  the  intermediate  buffer  or  is  ejected 
from  the  system. 


Figure  1.1. 

It  is  assumed  that  the  server  in  the  second  node  is  never  blocked  and  the  immediate  blocking 
stategy  is  adopted  for  the  first  node  server  in  that  the  blocking  of  this  server  occurs  as  soon  as  the 
intermediate  buffer  becomes  full.  Note  that  this  event  occurs  necessarily  at  a  service  completion. 
The  server  remains  blocked  until  the  congestion  is  reduced  at  the  second  node,  at  which  time  the 
blocked  server  resumes  service  and  begins  to  process  its  next  job  (if  any).  The  methodology  de¬ 
veloped  in  this  paper  also  applies  to  two  node  systems  under  the  non-immediate  blocking  policy 
whereby  the  first  node  server  is  blocked  at  a  service  completion  time  if  the  job  that  has  just  com¬ 
pleted  service,  cannot  proceed  to  the  intermediate  buffer  due  to  congestion.  When  the  congestion 
is  reduced  downstream,  this  job  proceeds  to  the  next  buffer  without  receiving  any  further  service, 
and  the  blocked  server  resumes  service  and  begins  processing  its  next  job  (if  any). 

The  discussion  is  given  here  for  the  discrete-time  model  while  the  results  for  the  continuous¬ 
time  formulation  are  only  briefly  mentioned  for  sake  of  completeness.  The  modelling  of  time  as  a 
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discrete  parameter  is  motivated  by  the  fact  that  service  times  in  manufacturing  systems  are  usually 
constant,  the  only  source  of  randomness  being  introduced  by  the  possibility  of  server  failures  and 
random  arrivals. 

Interest  in  the  simple  system  of  Figure  1.1  is  two-fold.  Firstly,  this  simple  model  can  be 
used  as  a  building  block  for  generating  approximation  algorithms  to  analyze  more  complex  tandem 
queueing  systems.  Indeed,  many  of  the  approximation  schemes  developed  for  general  tandem 
queueing  systems,  say  by  Altiok  [1],  Brandwajn  and  Jow  [4],  Gun  and  Makowski[10],  Ilillier  and 
Boling  [11]  and  Sheskin  [15],  to  name  a  few,  are  based  on  decomposition  and  isolation  ideas  that 
reduce  the  problem  to  one  of  simultaneously  solving  several  simpler  systems  which  are  special  cases 
of  the  model  studied  here.  These  ideas  clearly  motivate  a  careful  study  of  the  general  two  node 
tandem  systems  with  blocking,  with  a  view  towards  providing  exact  analytical  results  in  order  to 
enhance  existing  and  future  approximation  schemes.  Secondly,  an  efficient  analysis  of  such  two 
node  systems  is  of  independent  interest  as  they  can  be  used  to  model  some  practical  situations  [16]. 
In  an  earlier  paper,  in  the  case  of  exponentialy  distributed  service  times,  Konheim  and  Reiser  [12] 
obtained  an  algorithmic  solution  for  the  joint  queue-length  distribution  of  the  system  depicted  in 
Figure  1.1  at  steady  state  when  K\  =  oo  One  of  the  contributions  of  this  paper  is  to  identify  a 
class  of  two  node  tandem  systems  with  blocking  for  which  this  joint  queue  length  distribution  can 
be  obtained  in  closed-form. 

The  paper  is  organized  as  follows:  The  model  of  interest  is  described  precisely  in  Section  2.  In 
Section  3,  the  model  is  analyzed  when  the  Bernoulli  arrival  stream  has  parameter  A  by  making  use 
of  the  fact  that  the  underlying  Markov  chain  is  a  finite  state  Quasi-Birth-and-Death  (QBD)  process. 
As  pointed  out  by  Neuts  [14],  QBD  processes  enjoy  interesting  structural  properties  which  can  be 
used  to  advantage  in  the  computations.  Indeed,  under  fairly  general  assumptions,  the  stationary 
probability  vector  n  =  (tto,  tti ,  • .  •)  of  a  QBD  process  with  countably  infinite  state  space  exhibits 
the  matrix- geometric  property  [14],  i.e.,  there  exists  a  matrix  R  such  that 

7rfc+1  =  nkR,  k  >  0  (1.1) 

where  the  matrix  R  is  the  minimal  nonnegative  solution  of  a  matrix  quadratic  equation. 

For  finite  state  QBD  processes,  the  situation  is  somewhat  different  owing  to  the  presence  of 
boundary  states,  and  it  is  not  possible  in  general  to  assert  that  the  invariant  distribution  exhibits  a 
matrix-geometric  property.  However,  as  pointed  out  by  the  authors  in  [7]  and  [9],  it  is  sometimes 
possible  to  obtain  a  closed-form  solution  with  a  matrix-geometric  form  similar  to  (1.1).  The  prop¬ 
erties  that  define  such  QBD  processes  are  present  in  a  number  of  well-known  queueing  problems 
and  can  be  used  to  provide  an  explicit  expression  for  a  matrix  R  in  terms  of  the  model  parameters. 

The  solution  techniques  presented  in  [7]  and  [9]  apply  here  to  obtain  closed-form  matrix- 
geometric  expressions  for  the  invariant  probabilities  of  the  system  states  when  A  =  1  and  A  <  1, 
respectively.  In  the  case  A  =  1,  the  system  is  effectively  reduced  to  a  saturated  two  node  system 
in  that  the  input  queue  in  Figure  1.1  contains  K\  jobs  at  all  times,  so  that  the  first  node  server 
is  never  starved.  While  the  Markov  chain  may  have  several  ergodic  classes  if  A  =  1,  it  is  shown  to 
always  have  a  unique  ergodic  class  for  A  <  1. 
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The  results  are  extended  in  Section  4  to  unreliable  servers  with  PH-type  service  and  repair 
distributions.  The  effective  service  time  distribution  of  such  servers  is  shown  to  admit  a  PH-type 
represention  of  higher  order  so  that  the  methods  discussed  in  Section  3  apply.  To  illustrate  this 
point,  the  case  A  =  1  is  discussed  under  the  assumption  that  idling  servers  are  allowed  to  fail;  the 
case  where  only  operational  servers  fail  is  then  obtained  as  a  special  case.  In  section  5,  the  results 
are  supplemented  with  several  numerical  examples.  In  Section  6,  the  continuous-time  formulation 
is  briefly  discussed  and  major  differences  with  the  discrete-time  results  are  pointed  out. 

In  order  to  fix  the  terminology  used  in  the  paper,  several  definitions  and  results  from  the  theory 
of  nonnegative  matrices  are  collected  in  the  Appendix. 

A  word  on  the  notation  used  hereafter:  The  r  X  r  identity  matrix  is  denoted  by  Ir  and  the 
rxl  column  vector  of  ones  is  denoted  by  er,  while  the  r  x  r  matrix  and  the  1  x  r  dimensional 
row  vector  with  all  zero  entries  are  denoted  by  0rxr  and  0r,  respectively.  The  notation  x  is  used 
to  denote  1  —  x  for  0  <  x  <  1.  The  notation  y  >  0  is  used  if  each  entry  of  the  1  X  r  vector  y  is 
nonnegative  and  y  f  0r.  The  symbol  0  denotes  the  Kronecker  product  of  matrices. 

2.  TWO  NODE  TANDEM  SYSTEM  WITH  PH-TYPE  SERVERS  AND  FEEDBACK 

The  model  consists  of  two  nodes  with  finite  capacity  buffers  of  size  K\  and  I{2  in  front  of  the 
first  and  second  node  servers,  respectively,  inclusive  of  the  jobs  in  service.  Each  node  is  attended 
by  a  single  server.  The  service  times  at  each  node  are  assumed  to  be  independent  and  identically 
distributed  (i.i.d)  with  common  PH-distribution  given  by  the  irreducible  representations  (a,  A)  and 
(/3,B)  for  the  first  and  second  node  servers,  respectively.  The  service  times  at  different  servers 
are  also  assumed  mutually  independent.  The  row  vectors  a  and  /?,  and  the  matrices  A  and  B 
have  dimensions  lx/,  1  X  m,  /  X  /  and  m  X  m,  respectively,  and  the  corresponding  /  x  1  and 
ibxI  column  vectors  of  absorption  (service  completion)  probabilities  for  the  first  and  the  second 
node  server  are  denoted  by  a  and  6,  respectively.  The  reader  is  refered  to  [14,  Chap.  2]  for  the 
probabilistic  interpretation  of  the  notation  used  here.  It  is  assumed,  without  loss  of  generality,  that 
on+ 1  =  =  0.  Moreover,  the  matrices  (//  —  A)  and  (Im  —  B )  are  both  assumed  nonsingular  or 

equivalently,  that  service  completion,  from  any  initial  state,  is  certain  [14,  p.  45]. 

A  Bernoulli  arrival  stream  with  parameter  A  feeds  into  the  first  buffer  under  the  assumption 
that  an  arrival  which  sees  a  full  buffer  is  lost.  It  is  also  assumed  that  the  second  node  server  is 
never  blocked,  and  that  the  immediate  blocking  strategy  is  enforced  on  the  first  node  server.  A 
job  whose  service  is  completed  in  the  ith  node  server  receives  another  service  from  this  server  with 
probability  pi ,  0  <  Pi  <  1,  i  —  1,2,  i.  e.,  a  job  serviced  at  station  1  joins  the  intermediate  buffer 
with  probability  px  and  a  job  serviced  at  station  2  leaves  the  system  with  probability  p2. 

Under  this  feedback  mechanism,  the  effective  service  time  distibutions  are  again  of  PH-type 
with  irreducible  representations  (a,  A)  and  (/3,B)  where  A  =  A  +  pxaa  and  B  =  B  +  p2b/3.  The 
corresponding  effective  absorption  probability  vectors  are  now  given  by  a  =  p1a  and  b  =  p2b. 
In  order  to  avoid  simplify  the  notation,  feedback  will  be  directly  incorporated  into  the  PH-type 
representation  as  indicated  above,  i.  e.,  there  is  no  loss  of  generality  in  assuming  p2  —  p2  =  0,  so 
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that  A  -  A,  B  =  B,  etc... 

The  state  space  of  the  system  is  naturally  defined  to  be  the  set  E  given  by 


I<  i 

E=  U  Eh 

fci=0 

where  the  sets  Ekl ,  0  <  hi  <  R\ ,  are  defined  by 


(2.1a) 


E0  :={e  e  E  :  e  =  (0 ,k2,j),  1  <  h2  <  I(2}  U  {(0,0)}  , 

(*i,0,i),  k2  =  0 

e  £  E  :  e  =  (hi,  h2,  i,j ),  1  <  k2  <  K2 
,  (ki,K2,j),  k2  —  K2 


Eh  :={ 


}}.!< 


k\  <  K\ , 


(2.16) 


for  1  <  z  <  Z  and  1  <  j  <  m.  Here,  /?i  and  k2  represent  the  numbers  of  jobs  in  buffer  one  and 
two,  respectively,  while  i  and  j  represent  the  service  phases  at  the  first  and  second  node  servers, 
respectively.  The  phase  of  the  first  node  server  is  not  defined  when  it  has  no  job  to  process  or  when 
it  is  blocked,  while  the  phase  of  the  second  node  server  is  not  defined  when  the  second  buffer  is 
empty.  Note  that  the  sets  Ekl,  0  <  kt  <  Ki,  form  a  partition  of  the  state  space  E  of  the  Markov 
chain.  It  will  be  convenient  to  use  the  notation 


r  :=  (K2-l)lm  +  l  +  m  and  s:=K2m  +  1 
in  the  forthcoming  discussion. 

The  one-step  probability  transition  matrix  of  the  underlying  Markov  chain  defined  on  the  set 
E  is  denoted  by  P .  The  purpose  of  this  paper  is  to  find  any  invariant  probability  vector  n  of  P  in 
a  computationaly  efficient  way,  i.  e.,  any  1  x  (K^r  +  s )  row  vector  7r,  which  satisfies  the  equations 

7T  =  ttP  and  7re/fir+5  =  1.  (2.2) 

Any  such  vector  zr  is  partitioned  into  K\  -f  1  blocks  of  components,  say  w  =  (zro,  7Ti  , . . . , 
with  7Tq  being  a  1  X  s  vector  and  ?rkl,  0  <  Aq  <  Ku  being  1  x  r  row  vectors.  Each  block  entry 
71-fcj ,  0  <  A;i  <  Ki,  is  of  the  form  nkl  =  (nklo,  tt^i,  •  • . ,  /^k1i<2)  where  the  vector  wklk2  is  of  dimension 

'  Im  ,  1  <  hi  <  AT,  1  <k2<I{2, 

l  ,  1  <  hi  <  Aj,  k2  =  0, 

<  m  ,  hi  =  0,  1  <  h2  <  K2,  or 
f  ^  hi  <  I(\ ,  k2  —  K2, 

.  1  ,  hi  =  0,  h2  =  0, 


and  the  entries  of  each  vector  nklk2 ,  1  <  hq  <  Ku  1  <  h2  <  I{2,  are  ordered  as  (1, 1),  (2, 1), . . ., 

(/,  1),  (1, 2) ... ,  ...,(/-  1,  m),  (/,  m). 
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By  ordering  the  states  in  this  way,  the  matrix  P  can  be  put  in  the  form 


/  Bi  Bo 

\ 

B2  A\ 

Ao 

a2 

Ax  Ao 

V 


A2  A\  Aq 

a2  cj 


(2.3) 


where  the  block  entries  Bo,  Bx,  and  B2  are  of  dimensions  s  X  s,  s  X  r  and  r  X  s,  respectively,  and 
the  matrices  A;,  0  <  i  <  2,  and  Cx  are  of  dimensions  r  X  r.  These  matrices  are  given  by 


/  a 

b  ®  a  B  ®  a 


Bo  =  A 


\ 


b/3  ®  a  B  ®  a 


V 

/  1 

b  B 


b/3  (g»  a  B  ®  a 

b/3  ®  a  B  / 


Bx  =  X 


\ 


b/3  B 


V 


bf3  B 

b(3  B) 


B2=  X 


^0  /3  ®  a 

b(3  ®  a  B  ®  a 


\ 

i  A 

b®  A  B  ®  A 


b/3  ®  a  B  ®  a 

b(3  ®  a  B  ®  a 

0  } 


An  —  A 


\ 


b(3®  A  B®  A 


b/3®  A  B®  A 

b/3  ®  a  B  ) 


-  6  - 


A  i 


Ai 


/  A  A  A(/3  ®  aa) 

A(6®A )  Ad  A (B  ®  aa) 

A (6/3  ®  A)  Arf  A(J5  ®  act) 

A(6/3  0  A) 


/  0  /3  ®  aa 

I  6/3  ®  aa  B  ®  aa 


b/3  ®  aa  B  ®  aa 
b(3  0  aa 
0 


\ 


A<i 

A (6/3  0  a) 


A(I?0a)  I 
A5  / 


\ 


B  0  a  I 
0  / 


/  A  A(/3  0  aa)  \ 

6®  A  Cd  A(i?  0  aa) 

6/3  0  A  Cd  A(i?  ®  aa) 

b(3®A  Cd  A(B0a) 

V  6/3  ®  a  2?  / 


with  the  diagonal  entries  A<*  and  being  defined  by 


Arf  =  A  (5  0  A)  -f  A  (6/3  0  aa)  , 
Cd  =  if  0  A  +  A  (6/3  0  aa)  . 


In  the  following  sections,  this  model  will  be  analyzed  in  detail  when  A  =  1  and  A  <  1.  The 
results  will  then  be  generalized  to  capture  the  situation  of  unreliable  servers  with  PH-type  service 
and  repair  time  distributions. 

3.  ANALYSIS  OF  THE  MODEL 

3.1.  A  =  1 

When  A  =  1,  the  block  matrices  and  A2  are  all  equal  to  the  identically  zero  matrix 

with  appropriate  dimensions,  and  it  is  easy  to  see  that  the  subset  Ek1  of  E,  given  by  (2.1b),  is  an 
absorbing  set  of  the  Markov  chain  with  one-step  transition  matrix  P.  Therefore  the  system  can  be 
viewed  as  a  two  node  system  with  an  infinite  supply  of  customers  in  front  of  the  first  node  server, 
whence  the  intermediate  queue  size  and  the  phases  of  each  server  suffice  to  characterize  the  system 
behavior.  The  vector  717^,  as  defined  in  Section  2,  is  an  invariant  probability  vector  for  the  Markov 
chain  corresponding  to  this  new  system  with  state  space  Ekx  and  one-step  transition  matrix  C\. 

The  matrix  C\  has  the  same  QBD  structure  as  the  matrix  P.  The  similarity  is  emphasized  by 
denoting  its  block  entries  by  the  same  letters  as  the  corresponding  ones  for  the  matrix  P  but  in 
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calligraphic  style,  so  that 


Ci  = 


(Bi 

^0 

\ 

b2 

Ai 

Ao 

A2 

Ai  Ao 

a2 

Ai 

Co 

\ 

c2 

cj 

now 

have 

dimensions  l  X 

Im, 

l  x  l  < 

(3.1.1) 


matrices  ,4o,*4i  and  A2  are  all  of  dimensions  Im  X  Im ,  while  the  matrices  Co,  C\  and  C2  have 
dimensions  Im  X  m,  m  X  m  and  m  X  Im,  respectively,  and  are  given  by 

Ao  =  B  ®  aa,  A\  =  B  ®  A  4-  b(3  ®  aa,  A2  =  bf3  ®  A,  (3.1.2a) 

Bo  —  (3  ®  aot,  Bi  =  A,  62  —  b  ®  A,  (3.1.2b) 

Co  =  B®a,  Ci  —  B,  C2=b/3®a.  (3.1.2c) 

When  I{2  =  1,  i.  e.,  there  is  no  intermediate  buffer,  the  matrix  Ci  is  always  irreducible  and 
the  invariant  probability  vector  wk1  is  given  explicitly  by 


irKl0  =  ca  (I[  -  A)  and  irT<1  x  =  c/3(Im  -  B) 


-1 


with  c  =  (ESi  +  I?^)-1.  Here  ES \  denotes  the  expected  service  time  of  server  i,  i  =  1,2. 

However,  when  K2  >  1?  the  matrix  C\  can  have  several  ergodic  classes  as  pointed  out  in  [6, 
Chap.  3]  where  necessary  and  sufficient  conditions  are  given  for  the  irreducibility  of  the  matrix  C\. 
Necessary  conditions  for  any  invariant  probability  vector  of  C\  are  obtained  through  the  solution 
technique  of  [9],  provided  the  properties  (P0)-(P2)  below  hold  for  the  corresponding  QBD  process. 


(PO):  The  matrices  /;  —  B\  and  Im  —  C\  are  nonsingular. 

(PI):  There  exists  Im  X  Im  matrices  X  and  Y  such  that  the  equalities 

Ao  X  —  A2  Y  =  Qimxim  ,  Bq  X  =  0 ixim  and  C2  Y  =  Omxim 


(hm  ~  Al)(Ilm  ~  X){Ilm  -  Y)  =  Ao{hm  ~Y)  +  A2(I,m  ~  X) 
B2  (h  -Br)-1  Boihm  -Y)  =  A2{hm  -  X) 


XY  =  YX 
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and 


hold,  and  either  one  of  the  Im  X  Im  matrices  M  and  N  defined  by 


N  ( Iim  ~  A\)  X  +  Aq  ,  M  (7/m  —  A\)  Y  +  A2  (3.1.3) 


is  invertible. 

(P2)  :  There  exists  an  l  X  Im  matrix  V  such  that  B2V  =  .42- 

Property  (PO)  is  trivially  satisfied  under  the  irreducibility  assumptions  made  earlier  on  the 
PH-distributions  since  B\  —  A  and  C\  —  B.  Except  for  the  invertibility  of  the  matrices  M  and  N, 
it  is  an  easy  exercise  to  check  that  the  properties  (PI)  and  (P2)  are  also  satisfied  by  choosing 

X  =  Im®  (/,  -  e,a),  Y  =  (Im  -  em(3)  ®  7/  and  V  =  fi  ®  R.  (3.1.4) 

The  matrices  M  and  N  defined  in  (3.1.3)  can  be  written  in  terms  of  the  system  parameters  as 

M  =  (7m  -  em0)  ®Ii  +  (em0  -  B)  ®  A  (3.1.5a) 

N  =  7m  0  (/j  -  e,a)  +  B®  (eta  -  A)  .  (3.1.5  b) 

The  following  necessary  and  sufficient  conditions  for  the  invertibility  of  these  matrices  follows  from 
Lemma  2.3.17  and  Corollary  2.3.18  of  [6]  combined  to  the  irreducibility  of  the  PH-representations 
(a,  A)  and  (/?,  B).  To  that  end,  let  V  be  the  open  disc  centered  at  (|,  0)  in  the  complex  plane  with 
radius  |  and  let  Sp(Z)  denote  the  spectrum  of  the  matrix  Z. 

Lemma  3.1.1.  If  Sp(A)  C  V  (resp.  Sp(B)  C  V)  then  the  matrix  M  (resp.  N)  defined  by  (3.1.5) 
is  nonsingular.  However,  the  matrix  M  (resp.  N)  is  singular  if  the  matrix  A  (resp.  B)  is  singular. 

The  following  theorem,  stated  for  the  case  when  the  matrix  M  is  invertible  and  K 2  >  1,  follows 
immediately  from  Theorem  A.  13  of  the  Appendix  and  from  the  structural  results  obtained  in  [9]. 

Theorem  3.1.2.  Let  the  1  X  l  row  vector  x  be  the  unique  solution  to  the  equation 

x(A  +  aa)  =  x,  xei  =  1. 

If  the  matrix  M  is  invertible,  then  any  invariant  probability  vector  n  of  P  is  of  the  form 
7r  =  (0s,0r,. .  .jO^TT/cJ.  The  1  X  r  probability  vector  7 tk1  =  (7T/<-l0,  tt/CjI,  . . . ,  tt/Cj/^)  has  the 
matrix- geometric  property 


(  irKl0  S  Rk 2  1  ,  1  <  k2  <  Ki  , 

*lUk2  =  < 

(  rKl 0  S  Rk~2(B  ®  a)(Im  -  B)-1  ,  k2  =  I{2  , 
where  the  Im  X  Im  matrix  R  and  the  l  X  Im  matrix  S  are  defined  by 

R  ■.=  NM~l  and  S  :=  (/?  ®  (7/  -  A))  A/-1  , 


(3.1.6) 
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and  the  1  X  I  vector  'Kki o  satisfies  the  linear  equation 


X  —  TT/Cj  0 


K- 1 

ij  +  s  Y,  Rk~\h  ®  em)  +  SRK~2Co(Im  ~  C1)-1emx 

A;=l 


(3.1.7) 


When  A  =  1,  it  is  shown  in  [6]  that  in  statistical  equilibrium  the  probability  of  finding  jobs 
in  the  intermediate  buffer  coincides  with  probability  of  finding  K2  —  k2  jobs  in  the  case  when  the 
order  of  the  servers  is  reversed.  Melamed  [13]  provides  a  probabilistic  interpretation  for  this  kind  of 
reversibility  [13]  by  viewing  the  vacant  buffer  locations  (holes)  of  the  original  system  as  “occupied” 
by  fictitious  dual  jobs.  As  regular  jobs  march  through  the  buffer  in  one  direction,  the  holes  march 
in  the  opposite  direction  and  they  both  receive  identical  service  times. 

3.2.  0  <  A  <  1 

A  necessary  and  sufficient  condition  for  the  irreducibility  of  the  Markov  chain  associated  with 
the  matrix  P  of  one-step  transition  probabilities,  given  by  (2.3),  is  first  obtained.  Here,  unlike  for 
the  case  A  =  1,  the  uniqueness  of  the  corresponding  invariant  probability  vector  is  seen  to  hold. 
Since  0  <  A  <  1,  the  following  three  observations  are  easily  verified: 

(i)  The  directed  graphs  of  the  matrices  A\  and  C\  have  the  same  topological  structure  by  virtue 
of  Lemma  A. 3. 

(ii)  The  set  Ekx-\  is  reachable  from  every  state  in  the  set  and  vice  versa,  for  1  <  k\  <  K\. 

(iii)  The  state  (0,0)  is  reachable  from  every  state  in  the  set  Eq. 

The  next  theorem  readily  follows  from  observations  (i)-(iii)  and  the  irreducibility  of  the  PH- 
representation 

Theorem  3.2.1.  If  the  matrix  C\  given  by  (3.1.1)  is  irreducible,  so  is  the  matrix  P. 

Next,  even  when  the  matrix  P  is  not  irreducible,  it  is  now  shown  to  have  a  single  ergodic  class, 
whence  the  invariant  probability  distribution  vector  7T  is  always  unique.  Let  the  K\r  X  K\r  matrix 
P  be  obtained  by  deleting  the  first  s  rows  and  columns  of  P,  i.  e.,  P  is  the  submatrix  of  P  that 
governs  the  transition  mechanism  within  the  states  in  the  set  E  \  E0.  Assume  the  directed  graph 
G(P )  to  induce  several  ergodic  classes  and  a  set  of  transient  states,  as  would  be  the  case  if  C\  had 
several  ergodic  classes.  In  view  of  (ii),  the  set  Eo  is  reachable  from  all  of  the  ergodic  classes  of 
E  \  Eo,  whence  by  (iii),  the  state  (0,0)  is  reachable  from  every  ergodic  class  of  the  set  E  \  E0.  On 
the  other  hand,  if  (0,0)  — >  e  for  a  state  e  in  E,  then  e  will  be  in  the  communication  path  between 
the  state  (0, 0)  and  the  other  states  of  the  chain  to  which  (0, 0)  has  access,  while  if  (0, 0)  e,  then 
e  will  be  a  transient  state  of  the  chain  since  e  — >  (0, 0)  from  the  argument  given  above.  Therefore, 
in  the  directed  graph  G(P),  the  set  i?(o,o)  {e  e  E  :  (0,0)  — ►  e}  U  {(0,0)}  forms  an  irreducible 
class  while  the  set  E  \  -E}o,o)  forms  a  transient  class. 

The  next  theorem  follows  from  Theorem  A.  13  and  these  remarks. 

Theorem  3.2.2.  If  A  <  1,  the  Markov  chain  with  one-step  transition  matrix  P  always  has  a 
single  ergodic  class,  and  the  invariant  probability  vector  7T  as  defined  above  is  thus  unique. 
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In  order  to  obtain  a  closed-form  expression  for  this  unique  vector  tt,  nonsingularity  of  the 
matrices  ( Is  —  B\)  and  Ao  is  needed.  Since 

A 

—A  b  Im  —  A  B 

—A  b(3  Im  —  A  B 

—A  b(3  Im  —  A  B 

and  A  >  0,  Is  —  B\  is  invertible  if  and  only  if  the  matrix  Im  —  A B  is  invertible,  a  fact  easily 
established  by  a  direct  application  of  the  Gershgorin  Circle  Theorem  [2,  p.  500].  This  can  also  be 
seen  by  noting  that  p(B)  <  1  and  therefore  0  is  not  an  eigenvalue  of  the  matrix  Im  —  XB.  On  the 
other  hand, 

det(Ao)  =  Ar  det(A)  det(B)  [det(B  <g>  A)]I<2~1 

=  Xr  det(A)iI<2~1)m+1  det(BfK2~l)l+x  , 

where  the  second  equality  follows  from  properties  of  the  Kroneclcer  product  [5],  and  the  matrix  Ao 
is  invertible  if  and  only  if  both  A  and  B  are  invertible. 

As  a  result  of  this  discussion,  nonsingularity  of  both  A  and  B  will  be  assumed  for  the  discrete¬ 
time  model.  Although  this  may  seem  rather  restrictive,  many  well-known  discrete  PH-type  distri¬ 
butions  enjoy  this  property,  including  the  hypergeometric  and  negative  binomial  distributions,  to 
name  a  few. 

Under  the  invertibility  assumption  of  the  matrices  A  and  B,  the  matrix  P  is  the  probability 
transition  matrix  of  a  QBD  process  of  the  type  discussed  in  [7]  and  when  K\  >  1,  the  follow¬ 
ing  matrix-geometric  form  of  the  solution  is  an  immediate  consequence  of  the  grouping  technique 
discussed  in  this  reference. 

Theorem  3.2.3.  If  the  matrices  A  and  B  are  invertible,  then  the  unique  invariant  probability 
vector  7 r  =  (tto, i rj, . . . ,  /kk1)  has  the  following  structural  form 

7 T0  =  TT i  Bo  (Is  ~  BX)~l  , 

7Tfcl  =  7TKl  ((Ir-CMo^Ir)  RI<1~kl~1 

7T/C,  =  ( XW)~1  X  , 

where  the  1  X  r  vector  x  satisfies 

x  Z  =  0r  ,  x  >  0^  (or  x  <  Oj) 
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with  the  2 r  X  2 r  and  r  X  r  matrices  R  and  Z  and  the  r  X  1  vector  w  being  given  by 


n  _  |  (Ir  —  ^1  )  A)  Ir 

n  ~  1  -A2  A0_1  0rXr 


)/<i-2  / B2 (Is  —  Bi)  1  Bq  +  A\  —  Ir 


Z  =  ((Ir  -  C\)  Aq1  ,Ir)  R‘ 

r)  Rk^^IJ^B2{Is  -  B,rxe.,A'pRK^-1  (QV) 


w  = 


+  er. 


Note  that  the  scalar  (xw)  is  a  normalization  constant  and  the  vector  w  need  not  be  computed 
as  the  normalization  can  be  performed  after  computing  all  the  vectors  7 ,  0  <  k\  <  K\ .  Much 
simpler  expressions  can  easily  be  obtained  for  the  case  K\  —  1. 

4.  EXTENSIONS  TO  SERVERS  SUBJECT  TO  FAILURES 

In  this  section,  a  class  of  unreliable  servers  with  PH-type  service  and  repair  time  distributions  is 
introduced.  The  effective  service  time  distribution  of  such  servers  is  shown  to  admit  a  PH-type  rep- 
resention  of  higher  order  so  that  the  methods  of  the  previous  section  apply.  Under  the  irreducibility 
assumption  on  the  service  and  repair  PH-distributions,  necessary  and  sufficient  conditions  for  the 
irreducibility  of  the  effective  service  representation  are  established.  The  situation  where  even  idling 
servers  may  be  subject  to  failure  is  considered.  The  case  when  only  operational  servers  can  fail  is 
obtained  as  a  special  case  of  this  discussion. 

4.1.  Representation  of  The  Effective  Service  Time  Distribution 

Consider  the  following  model  for  a  PH-type  server  subject  to  occasional  failures:  The  service 
and  repair  distributions  have  irreducible  PH-representations  (a“,A“)  and  (ad,  Ad)  of  order  m  and 
n,  respectively,  with  corresponding  to  X  1  and  rax  1  column  vectors  of  absorption  probabilities  au 
and  ad,  respectively.  Again,  in  order  to  avoid  situations  of  limited  interest,  take  a^+1  =  ad+i  =  0- 
Let  the  sets  S,  R  and  T  be  defined  by 

S  :=  {sj,  1  <  i  <  m},  R  :=  { rj ,  1  <  j  <  ra),  T  :=  S  U  R  , 

where  s,  and  rj  are  the  ith  service  phase  and  the  jth  repair  phase,  respectively.  Let  C  and  D 
be  to  X  ra  and  n  X  to  non- negative  matrices  with  entries  Cij  and  Dij ,  1  <  i  <  to,  1  <  j  <  ra, 
respectively,  with  the  property  that  Cen  =  em  and  Dem  =  en.  Similarly,  let  the  1  X  to  column 
vector  /  have  non-negative  entries  /,-,  1  <  i  <  to. 

It  is  assumed  that  when  the  server  is  up  and  in  phase  of  service  i ,  it  can  fail  with  probability 
fi,  1  <  i  <  to,  and  the  repair  process  is  initialized  at  phase  j  with  probability  Cij ,  1  <  i  <  to,  1  < 
j  <  ra.  Similarly,  when  the  repair  is  completed,  i.e.,  whenever  there  is  a  transition  from  a  transient 
phase  j  to  the  absorbing  phase  ra  +  1  of  the  repair  distribution,  the  service  restarts  at  a  phase  i 
with  probability  Dji,  1  <  j  <  ra,  1  <  i  <  to.  Moreover,  a  failure  at  a  repair  completion  epoch 
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is  not  allowed.  In  addition  to  these  fairly  general  transition  mechanisms,  the  server  is  allowed 
to  fail  at  a  service  completion  epoch  with  probability  <j>  and  reinitialization  of  the  repair  phase  is 
then  done  according  to  the  probability  distribution  vector  ad .  The  natural  conditions  <j>  <  1  and 
fi<  1,  1  <  i  <  m,  are  imposed  throughout. 

Under  these  assumptions,  it  is  easy  to  see  that  the  effective  service  time  distribution  of  such 
a  server  admits  a  PH-type  distribution.  To  that  end,  consider  a  discrete-time  Markov  chain  on 
the  state  space  T  U  {-sm+i},  where  sm+i  is  interpreted  as  the  instantenous  state  for  the  PH- 
representation  of  the  (effective)  service.  The  corresponding  one-step  transition  matrix  Q  and  the 
initialization  probability  vector  are  of  the  form 


a) 
m  l) 


and  (a,  am+n+i) 


respectively,  with  a  =  (a2,  a2, . . . ,  am+n),  where  A,  a  and  a  are  of  dimension 

(m  +  n)  X  (m  +  n ),  (m  +  n)  X  1  and  1  X  (m+  ra),  respectively.  The  equalities 


/A7A“  A  fC\ 

A=\ 

(4.1.1a) 

\Aad  D  Ad  J 

(  A-j  au\ 

(4.1.16) 

a~\  ol  )  ’ 

a-(J)au  ,<f>ad)  , 

(4.1.1c) 

readily  follows,  where  the  notation  Ax  :=  diag(x\,.  ..,xi)  is  used  for  all  x  in  JR1.  The  relations 
A  f  em  =  f  and  A ad  en  =  ad  easily  follows. 

The  effective  service  distribution  of  such  a  server  thus  has  a  PH-representation  (a,  A)  of  order 
n  +  m.  The  assumption  a^+1  =  ad+1  =  0  implies  am+n+]  =  0.  The  irreducibility  of  the  service 
and  the  repair  distributions  does  not  guarantee  the  irreducibility  of  the  effective  representation 
(a,  A).  However,  the  following  neccessary  and  sufficient  conditions  are  given. 

Lemma  4.1.1.  The  PH-representation  (a,  A)  is  irreducible  if  and  only  if  every  state  rj  in  the  set 
R\  R*  is  reachable  from  the  set  R*  under  the  transition  mechanism  induced  by  G(Ad),  where 

R*  : = { r y  €  R  :  rj  is  reachable  from  the  set  S  under  G{A  +  aa)  }  . 

Moreover,  if  a  state  rj  in  R\  R*  is  not  reachable  from  R* ,  then  rj  is  a  transient  phase  for  the 
PH-representation  {a,  A). 

Proof.  By  definition,  the  irreducibility  of  the  PH-representation  (a,  A)  is  equivalent  to  the 
irreducibilty  of  the  (m  +  n)  X  (m  +  n )  matrix  A  +  aa ,  which  is  readily  given  by 


A  +  aa 


Aj  Au  +  <j>  Aj  au  au  Af  C  +  4>  Ajau  ad 
A a*  D  Ad 
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Now,  the  property  Si  — »  Sj<,  1  <  i,i'  <  m,  is  a  direct  consequence  of  the  irreduciblity  of  the 
matrix  A jAu  +  <f>Ajauau,  a  fact  which  follows  from  Lemma  A. 3,  since  by  assumption  (j>  <  1, 
fi  <  1,  1  <  i  <  m,  and  the  representation  (au,Au)  is  irreducible.  Therefore,  every  state  s  in  S 
communicates  with  any  other  state  in  S  without  leaving  S.  On  the  other  hand,  since  (/„  —  Ad) 
is  assumed  invertible,  Ad  is  substochastic  and  ad  ^  .  This  fact,  together  with  the  fact  that  the 

states  {ri, . . . ,  rn}  are  all  transient  for  the  representation  ( ad ,  Ad )  yields  the  access  relation  rj  —*■  s, 
for  every  rj  in  R  and  s,  in  S. 

(Sufficiency)  The  sufficiency  part  of  the  first  assertion  of  the  Lemma  now  foilows  from  the  hypoth¬ 
esis,  since  every  rj  in  R\  R*  is  reachable  from  R* ,  thus  communicating  with  the  set  S  U  R*. 
(Necessity)  Follows  trivally  by  the  definition  of  irreducibility  and  the  form  of  the  matrix  A  +  aa  in 
that  the  transitions  within  the  set  R  are  governed  by  the  matrix  Ad  only ,  due  to  the  assumption 
that  failures  are  not  allowed  at  repair  completions. 

The  second  part  of  Lemma  4.1.1  also  follows  easily  from  the  above  discussion.  Since  ad  0^, 
the  underlying  Markov  chain  will  eventually  leave  the  set  R  and  enter  the  set  S.  If  rj  in  R  \  22*  is 
not  reachable  from  the  set  R*,  then  rj  will  never  be  revisited  and  will  be  a  transient  state  for  the 
Markov  chain.  n 

In  some  applications  the  server  may  fail  with  a  positive  probability  at  a  service  completion 
epoch,  i.  e.,  <j)  >  0.  In  that  event,  since  au  ^  0^,  there  exists  some  i,  1  <  i  <  m,  such  that  a“  >  0, 
whence  Sj  — ►  rj  for  every  rj  in  the  set  12*  :=  {1  <  j  <  n  :  ad  >  0)  as  the  repair  phase  is  initialized 
according  to  ad.  Since  the  representation  (ad,  Ad)  is  irreducible,  every  state  r  in  i2  \  i2*  must  be 
reachable  from  the  set  22*  since  otherwise  r  will  be  a  transient  state  for  the  matrix  Ad  +  adad  thus 
contradicting  the  irreducibility  of  (ad,Ad).  Therefore,  arguments  similar  to  the  ones  that  lead  to 
the  sufficiency  part  of  Lemma  4.1.1  show  that  the  representation  (a,  A)  is  irreducible. 

Since  (a,  A)  is  constructed  from  basic  building  blocks  and  not  given  from  the  onset,  invertibility 
of  the  matrix  Im+n  —  A  is  not  automatically  guaranteed.  A  sufficient  condition  is  obtained  in  the 
following  Lemma. 

Lemma  4.1.2.  The  matrix  Im+n  —  A  is  invertible  whenever  the  PH-representation  (a,  A)  is 
irreducible. 

Proof.  The  directed  graph  G(A)  may  in  general  induce  several  ergodic  classes.  However,  the 
irreducibility  of  the  representation  (a,  A)  implies  that  all  of  these  classes  communicate  with  each 
other  through  ,sm+1  in  the  access  relation  induced  by  G(A  +  aa),  and  therefore,  the  states  in  T 
are  all  transient  for  the  Markov  chain  with  one-step  probability  transition  matrix  Q.  On  the  other 
hand,  if  G(A)  induces  a  single  ergodic  class,  the  states  in  T  are  again  all  transient  since  sm+ 1  is 
indeed  an  absorbing  state  for  Q,  i.  e.,  a  ^  0^+n  from  (4.1.1b),  owing  to  the  assumption  that 
au  and  fi  <  1,  1  <  i  <  m.  The  invertibility  of  (/m+„  —  A)  is  now  immediate  since  it  is 

equivalent  to  the  statement  that  the  states  in  T  are  transient  for  the  Markov  chain  with  one-step 
probability  transition  matrix  Q  [14,  Lemma  2.1.1.  p.  45].  E] 

The  representation  of  the  effective  service  time  given  above  for  such  a  faliure  type  server 
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subsumes  tlie  case  when  the  server  is  reliable ,  i.  e.,  <f>  =  0  and  /  =  0^,  in  which  case,  the  matrix 

.  .  ,  ,  -  ,  Au+auau  0m> 

A  +  aa  takes  the  form 


A  ad  D 


A*"  )  .  This  special  case  also  provides  a  trivial  example 


for  the  representation  (a.  A)  not  to  be  irreducible,  although  the  representation  (a“,  Au)  for  the 
service  duration  is.  If  the  representation  (a,  A)  is  not  irreducible,  Lemma  4.1.1  provides  general 
guidelines  for  identifying  the  corresponding  irreducible  representation.  In  the  following  section,  the 
representation  (a,  A)  is  assumed  irreducible  so  that  the  matrix  (/m+n  —  A)  is  invertible. 

To  conclude,  it  should  be  kept  in  mind  that  the  matrices  C  and  D ,  corresponding  to  transition 
probabilities  between  the  service  and  repair  phases,  take  special  forms  depending  on  the  assumptions 
made.  For  instance,  if  upon  completion  of  a  repair,  the  phase  of  service  is  reinitialized  according 
to  au ,  and  similarly  if  upon  a  failure  the  phase  of  repair  is  initialized  according  to  ad,  then  C  and 
D  take  the  special  forms  C  =  em  ad  and  D  =  en  au.  When  C  ~  em  ad,  it  is  an  easy  exercise  to  see 
that  the  representation  ( a ,  A)  given  by  (4.1.1)  is  irreducible  regardless  of  the  form  of  the  matrix  D. 


4.2.  Two  Node  System  With  PH-Type  Failure  Servers 


The  model  of  Section  2  is  considered  for  the  case  when  A  =  1.  The  case  0  <  A  <  1  is 
straightforward  and  omitted  to  avoid  an  already  lengthy  manuscript.  Feedback  is  again  ignored 
in  order  not  to  further  complicate  the  notation  as  it  can  easily  be  incorporated  as  mentioned  in 
Section  2.  The  servers  are  assumed  subject  to  failures  even  when  they  are  idling.  The  first  and 
second  node  servers  have  irreducible  PH-representations  of  the  form  (4.1.1),  denoted  by  (a,  A)  and 
(/3,B),  respectively,  by  using  the  notation  of  Section  2.  The  service  and  repair  PH-representations 
of  the  first  and  the  second  node  server  are  of  order  m,  and  7i;,  i  =  1,2,  respectively.  They  are 
again  denoted  by  the  same  letters  as  the  effective  representations  but  with  superscripts  u  and  d. 
It  is  assumed  that  an  idling  server  fails  with  probability  i  =  1,2,  and  upon  failure  the  phase 
of  repair  is  initialized  according  to  the  initialization  vector  ad  and  /3d  for  the  first  and  the  second 
node  server,  respectively.  For  sake  of  compactness,  set 

Ti  =  m,  +  m ,  i  —  1,2,  h  =  ri  r2, 

hi  =  ri  (1  +  n2)  ,  h2  =  r2(l  +  n1)  . 

Dropping  the  index  for  the  first  queue,  the  state  set  E  of  the  system  contains 
\E\  —  {K2  —  1  )h  +  hi  +  h2  states  with 


(o,0 , 

k  2 

=  0, 

1  <  i 

< 

n, 

(0 ,i,j)  , 

h 

=  0, 

1  <  i 

< 

ri  and  m2  +  1 

<  3 

< 

r2, 

(*2 ,i,j)  , 

0  <  k2  <  K2, 

1 

<  i  <  r\  and  1 

<  3 

< 

f2, 

(B2,i,j)  , 

k2 

=  K2 

,  mi 

+ 

1  <  *  <  r*i  and 

1  < 

3 

<  r2 

(K2J)  , 

h 

=  k2 

,  1  < 

3 

<  r2. 

Here,  k2  again  indicates  the  intermediate  buffer  size,  while  i  and  j  represent  the  service  or  repair 
phase  in  the  first  and  the  second  node  server,  respectively.  The  phase  of  service  of  the  second  node 
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server  is  not  defined  when  it  has  no  jobs  to  process  and  the  phase  of  service  of  the  first  node  server 
is  not  defined  when  the  intermediate  buffer  is  full  as  it  is  blocked.  The  pairs  (0,i),  1  <  *  <  rq, 
and  (K2,j),  1  <  j  <  r2,  correspond  to  the  states  where  the  second  and  the  first  node  server, 
respectively,  are  functional  but  idle. 

By  ordering  the  states  as  in  Section  2,  the  one-step  state  transition  matrix  C\  of  the  underlying 
Markov  chain  can  be  obtained  in  the  same  block  tridiagonal  form  as  in  equation  (3.1.1).  Since  the 
effective  service  time  distribution  is  still  PH-type,  the  intermediate  block  entries  of  the  matrix  C\ 
are  still  given  by 


Mo  =  B  0  acc,  Mi  =  B  <g>  A  +  b/3  ®  aa  and  M2  =  b(3  ®  A, 


where  now  each  block  is  an  h  X  h  matrix.  For  the  boundary  states  the  entries  are  given  by 

92  Pu  92  Pa 


»  _  /  air  m  P  \ 

Bo~  Abd  D2  Bd  ) 


aa 


Bi 


92  92  Pd 

bd  Bd 


A 


B2  =  b  (<f>2,<p2Pd)  ®  A 

C0  =  ((f>i  B  ®  a  ,  <j>i  B  ®  a  ad ) 


n  _  (  9 1  B 
61  -(  B®  ad 


9i  B  ®  ad 
B  ®Ad 


b{3®(g1au,giad)\ 
bp®( Aa«  DuAd)J 


hi  x  h  matrix, 

hi  x  hi  matrix, 

h  X  hi  matrix, 
h  X  h2  matrix, 

h2  X  h2  matrix. 
h2  x  h  matrix, 


Since  the  effective  service  representations  (a,  A)  and  (P,B)  are  both  assumed  irreducible,  the 
results  of  [6]  can  be  used  to  characterize  the  irreducibility  of  the  Markov  chain  studied  here. 

Except  for  the  invertibility  of  the  matrices  M  and  N ,  it  is  a  straightforward  exercise  to  show 
that  the  properties  (PI)  and  (P2)  are  again  satisfied,  by  choosing 

X  =  Ir2®  (/n  -  eria),  Y  =  ( Ir2  -  er2(3)  ®  Iri  and  V  =  (3  ®  Iri. 

The  matrices  M  and  N  are  again  given  by  (3.1.5),  with  the  subscripts  l  and  m  of  I  and  e  now 
replaced  with  rq  and  r2,  respectively. 

The  invertibility  of  the  matrices  I ^  —  Bi  and  Ih2  —  Ci  is  needed  in  order  for  the  property  (PO) 

to  hold.  To  see  this  for  i/i2  —  Ci ,  note  that  the  stochastic  matrix  ^  ^  ^  has  eigenvalues  in 

the  closed  unit  disc,  while  the  matrix  B  has  eigenvalues  in  the  open  unit  disc  of  the  complex  plane. 
It  is  an  easy  exercise  to  show  that  if  (A ,u)  and  (/i,u)  are  right  eigenpairs  for  the  matrices  B  and 

)  ’  resPectively»  ^ien  (A  n,  u  ®  v )  is  a  right  eigenpair  for  the  matrix  Ci .  The  eigenvalues 

of  C\  are  therefore  all  in  the  open  unit  disc,  or  equivalently  the  eigenvalues  of  1^ 2  —  C\  have  strictly 


-  16  - 


positive  real  parts,  and  the  matrix  Ih2  —  C\  is  invertible.  The  nonsingularity  of  the  matrix  1^  -  B\ 
can  be  shown  in  a  similar  way. 

Therefore,  if  one  of  the  matrices  M  or  N  is  invertible,  the  properties  (P0)-(P2)  are  again 
satisfied  and  the  same  structural  result  of  Theorem  3.1.2  also  holds  true  for  the  case  when  servers 
are  subject  to  breakdowns.  However,  this  time  the  1  X  h\  vector  -kkx 0  satisfies  the  equation 

TT/Cj o  Z  =  0h  and  ttKi0  w  =  1,  (4.2.1) 

where  the  hi  X  h  matrix  Z  and  the  hi  X  1  vector  w  are  given  by 

k2-  i 

Z  =  sj2  Rk2~\h  -  (B  +  b/3)  ®(A  +  aa))  -  A0  +  SA2  +  SRK*~2(Ao  -  C0(Ih2  -  C1)~1C2 ) 

fc2  =  1 

I<2~  1 

w  =  ehl  +  5  2  Rk*~xeh  +  SRK*-2C0{Ih2-Ci)-leh2  . 
k2  —  1 

Equation  (4.2.1)  is  obtained  by  summing  the  balance  equations  corresponding  to  the  block 
entries  "Kk^i  1  <  k2  <  K2,  and  using  the  normalization  condition  tt k^\e\  =  1- 

Special  Case  -  When  only  operational  failures  are  allowed 

The  solution  for  the  case  when  idling  servers  do  not  fail  can  be  obtained  as  a  special  case 
of  the  discussion  given  above.  In  this  case,  even  if  the  servers  do  not  fail  when  idling,  the  same 
state  description  has  to  be  used  as  a  server  can  still  fail  at  the  time  epoch  of  a  service  completion. 
Therefore,  the  results  of  this  case  can  be  obtained  by  setting  g2  =  0  in  C\  and  C2  and  by  setting 
g2  =  0  in  Bo  and  B\. 

5.  NUMERICAL  EXAMPLES 

In  this  section,  the  effects  of  failures  on  the  invariant  probabilities  of  the  model  of  Section  2 
are  illustrated  through  several  numerical  examples.  For  a  buffer  size  of  K  =  5,  the  following  three 
situations  are  considered  when  A  =  1: 

(i)  The  case  when  both  servers  are  reliable  and  have  Negative  Binomial  service  time  distributions 
with  PH-representations  ( au,Au )  and  (/ 3U,BU ). 

(ii)  The  case  when  both  servers  are  subject  to  failures  and  have  service  distributions  as  in  (i),  and 
the  first  server  has  a  geometric  down  time  distribution  with  parameter  0.8,  while  the  second 
server  has  hypergeometric  down  time  distribution  with  PH-representation  (/3d,  Bd).  In  this 
case  the  idling  servers  are  allowed  to  fail  with  probabilities  g i  =  0.2  and  g2  =  0.3. 

(iii)  In  this  case  both  servers  are  subject  to  failures  and  have  service  and  repair  distributions  as  in 
(ii),  but  idling  servers  are  not  allowed  to  fail. 

The  following  numerical  values  are  considered. 
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0°  =  (1,0), 


_  / 0.6  0.4  \ 

B  ~  0  0.5 )  ’ 

°6)  ,  0d  =  (0-4, 0.6)  , 


od  /  0.5  0 

B  =  1  0  0. 


The  matrices  A/;,  C,  and  D,,  i  =  ,  1,2,  are  given  by 


and 


,0.1  0  1  .  _  7  0.2  0 

A/l  _  '  0  0.1  /  ’  h  -  V  0  0.2 


Ci  =  (^J  ,  C2  =  e2t3d  ,  Dl  =  au,  D2  =  e2  P 


while  the  probabilities  of  a  failure  at  a  service  completion  are  (j>\  =  0.2  and  <j)2 
the  effective  service  time  representations  (a,  A)  and  (/3,_B)  are  given  by 


0.32  0.08 
0.4  0.08 

0  0.5 

0  0 


0.3.  Therefore 


0.72 

0.18 

0-1  \ 

/  0.48 
0 

0.5 
V  0.4 

0 

0.27 

0.1  , 

B  = 

0.8 

0 

0.2  J 

and 

a  =  (0.8, 0, 0.2)  ,  p  =  (0.7, 0, 0.12, 0.18)  . 

If  the  random  variables  Si,  R ,•  and  Sf^,  i  =  1, 2,  denote  the  service  time,  repair  time  and  the 
effective  service  time  of  the  ith  server  for  i  —  1,2,  respectively,  then  the  above  numerical  values  lead 
to  the  following  expected  values:  2?[5i]  =  7,  E[S2\  =  4,  E[Ri]  =  1.25,  E[R2\  —  2.3,  E[Sl^\  = 
9.28,  and  E[S2**]  =  11.18.  Note  that  although  E[S\  +  i?i]  >  E[S2  +  R2],  the  average  effective 
service  time  of  the  second  node  server  is  greater  then  the  average  effective  service  time  of  the  first 
node  server  since  the  second  node  server  is  more  likely  to  breakdown.  The  effect  of  breakdowns  can 
easily  be  seen  from  the  queue  size  probabilities  in  Table  5.1.  As  expected,  in  the  first  case,  there 
are  fewer  than  three  jobs  in  the  buffer  for  most  of  the  time  whereas  in  cases  II  and  III  there  are 
more  than  three  jobs  in  the  buffer  for  most  of  the  time.  On  the  other  hand,  although  the  second 
server  has  a  higher  probability  of  failure  when  it  is  idle,  the  probability  of  having  zero  or  one  job  in 
the  buffer  is  sligthly  less  in  case  II  then  in  case  III.  The  reason  for  this  is  that  the  idling  probability 
of  the  first  node  server  is  high  enough  to  offset  this  difference,  so  that,  relative  to  the  second  node 
server,  the  first  node  server  is  slightly  slower  in  case  II. 
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Steady  state  queue  size  probabilities 

Queue  size 

Case  1 

Case  2 

Case  3 

0 

0.3042 

0.0619 

0.0672 

1 

0.3950 

0.1131 

0.1143 

2 

0.1904 

0.1495 

0.1483 

3 

0.0758 

0.1952 

0.1936 

4 

0.0286 

0.2513 

0.2492 

5 

0.0059 

0.2290 

0.2275 

Table  5.1. 

6.  THE  CONTINUOUS-TIME  FORMULATION 


In  this  section,  the  solution  to  the  continuous-time  formulation  of  the  model  of  Section  2 
is  briefly  discussed.  Although  the  same  solution  techniques  can  be  used,  the  continuous-time 
formulation  has  two  advantages:  (i)  The  matrix  C\  is  irreducible  and  so  is,  by  Theorem  3.2.1, 
the  matrix  P  given  by  equations  (3.1.1)  and  (2.2),  respectively,  are  both  irreducible.  The  reader 
is  referred  to  [6,  p.  51]  for  a  proof  of  the  irreducibility  of  the  matrix  C\  in  this  case,  (ii)  No 
invertibility  assumptions  are  needed  for  all  values  of  A.  For  the  case  A  =  oo,  both  matrices  M 
and  N  are  invertible  [9].  For  the  case  A  <  oo,  Ao  =  A/r,  and  no  matrix  inversion  is  required  to 
obtain  the  R  matrix.  Similar  extensions  to  systems  with  failure  servers  are  available  [6].  Feedback 
from  the  second  node  server  to  the  first  buffer  can  also  be  incorporated  into  the  solution  since  the 
underlying  QBD  process  will  have  a  similar  structure,  while  for  the  discrete-time  formulation  this 
type  of  feedback  does  not  yield  a  QBD  process. 
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APPENDIX 


In  this  Appendix,  several  definitions  and  results  from  the  theory  of  nonnegative  matrices  are 
presented  for  sake  of  easy  reference.  The  reader  is  referred  to  Berman  and  Plemmons  [3]  for  a  general 
reference  on  the  theory  of  nonnegative  matrices.  Throughout  the  discussion,  all  the  matrices  have 
real  entries  unless  otherwise  mentioned. 

Definition  A.l.  An  nxn  nonnegative  matrix  A  is  cogredient  to  an  nxn  matrix  E  if  for  some 
permutation  matrix  P ,  PAPT  =  E.  The  matrix  A  is  said  to  be  reducible  if  it  is  cogredient  to 


where  B  and  D  are  square  matrices,  otherwise,  A  is  said  to  be  irreducible. 

Definition  A. 2.  The  directed  graph  G(A)  associated  with  an  n  x  n  nonnegative  matrix  A  is 
the  graph  made  up  of  n  vertices,  say  Pi,  P2, . . .  Pn,  with  an  edge  leading  from  P,  to  Pj  if  and  only 
if  Aij  >  0,  1  <  i,j  <  n. 

It  is  well  known  [3,  p.  30]  that  a  matrix  A  is  irreducible  if  and  only  if  G(A)  is  strongly  connected , 
that  is,  for  every  ordered  pair  (Pi,  Pj)  of  vertices  of  G(A),  there  exists  a  path  (i.  e.,  a  sequence  of 
edges)  which  leads  from  Pi  to  Pj.  The  following  Lemma  is  a  simple  application  of  the  Definition 
A. 2  and  will  be  useful  in  the  proofs  of  Theorems  3.2.1  and  Lemma  4.1.1. 

Lemma  A. 3.  For  any  two  nonnegative  square  matrices  A  and  B,  the  matrix  (A+B)  is  irreducible 
if  and  only  if  the  matrix  (c\  A  +  c2B)  is  irreducible  for  all  scalars  c\,c2  >  0. 

Proof.  Owing  to  the  nonnegativity  of  the  matrices  A  and  B,  (A  +  B)ij  >  0  if  and  only  if 
(ci  A  +  c2  B)ij  >  0,  whenever  Cx,c2  >  0,  while  (A  +  B),j  =  0  if  and  only  if  Aij  =  B,j  =  cj  A,j  + 
c2  Bij  =  (ci  A  +  c2  B)ij  =  0  .  The  directed  graphs  G(A  +  B)  and  G^ci  A  +  c2  B),  C\,  c2  >  0,  thus 
have  exactly  the  same  topology,  and  the  result  follows  by  Definition  A.l.  □ 

When  a  nonnegative  matrix  is  stochastic,  the  notion  of  irreducibility  in  the  Definition  A.l 
is  related  to  the  probabilistic  one  in  that  every  stochastic  matrix  can  be  viewed  as  the  one-step 
transition  matrix  of  a  Markov  chain.  In  order  to  clarify  the  terminology,  it  is  necessary  to  classify 
the  states  of  a  Markov  chain.  Thus  consider  a  finite  state  Markov  chain  on  the  state  space  S  = 
{si 5  ;  >sn}. 

Definition  A. 4.  If  in  the  state  transition  diagram  of  the  Markov  chain  S  there  exists  a  path  from 
state  Si  in  S  to  state  Sj  in  S,  then  the  state  Si  is  said  to  have  access  to  state  Sj,  written  Si  — ►  Sj. 
If  s,  has  access  to  Sj  and  Sj  has  access  to  Si,  then  s,  and  Sj  are  said  to  communicate,  written  as 
Si  <-»  Sj  . 

Implicit  in  Definition  A.4  is  that  every  state  in  S  communicates  with  itself,  and  with  this 
convention,  the  communication  relation  is  an  equivalence  relation  on  the  set  of  states  and  thus 
partitions  S  into  equivalence  classes.  With  this  in  mind,  the  following  definition  is  given. 
Definition  A. 5.  A  state  S{  in  S  is  called  transient  if  there  exists  some  Sj  ^  s,  in  S  with  the 
property  that  Si  — >  Sj  but  Sj  />  S{,  i.  e.,  Si  has  access  to  some  other  state  which  does  not  have 
access  to  Sj.  Otherwise,  the  state  si  is  called  ergodic. 
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Thus,  Si  is  ergodic  if  and  only  if  Si  — >  Sj  implies  Sj  — >  Si  for  some  sj  ^  s,  in  S .  It  follows 
that  if  one  state  in  an  equivalence  class  of  states  associated  with  a  Markov  chain  is  transient  (resp. 
ergodic),  then  each  state  in  that  class  is  transient  (resp.  ergodic).  This  leads  to  the  next  definition. 

Definition  A. 6.  A  class  induced  by  the  communication  relation  on  the  set  S  is  called  transient 
if  it  contains  a  transient  state  and  ergodic  otherwise. 

Definition  A. 7.  A  Markov  chain  is  called  irreducible  if  it  consists  of  a  single  ergodic  class. 

In  view  of  the  above  definitions,  the  following  Lemma  can  easily  be  proved. 

Lemma  A. 8.  A  finite  state  Markov  chain  is  irreducible  if  and  only  if  the  corresponding  one-step 
transition  matrix  is  irreducible. 

Therefore,  these  two  concepts  of  irreducibility  are  used  interchangeably  in  this  paper.  The 
following  notion  of  reachability  is  used  repeateadly. 

Definition  A. 9  Let  U  and  V  be  subsets  of  the  state  space  of  a  Markov  chain  with  corresponding 
one-step  probability  transition  matrix  T.  The  set  U  is  reachable  from  the  set  V  if  there  is  a  path 
from  some  state  in  V  to  a  state  in  U  in  the  directed  graph  G{T )  of  the  matrix  T. 

The  following  theorem  is  a  basic  result  in  the  Perron-Frobenius  theory  of  nonnegative  matrices. 

Theorem  A. 10.  If  A  is  an  n  X  n  nonnegative  matrix,  then 

(i)  The  spectral  radius  p(A)  of  A  is  an  eigenvalue  of  A,  and 

(ii)  There  always  exists  left  and  right  eigenvectors  with  nonnegative  components  which  corre¬ 
sponds  to  p(A). 

The  invariant  probability  vector  w  of  an  n-state  Markov  chain  with  one-step  probability  tran¬ 
sition  matrix  A  is  defined  as  the  1  X  n  vector  n  that  satisfies 

7r  A  =  7r  ,  iren  —  1  . 

The  following  results  investigate  the  existence  and  uniqueness  of  the  invariant  probability  vector  of 
a  finite  state  Markov  chain. 

Theorem  A. 11.  Every  finite  state  Markov  chain  has  an  invariant  probability  vector. 

Proof.  Let  the  tixn  matrix  A  be  the  state  transition  matrix  associated  with  the  chain.  It  is  well 
known  [3]  that  for  any  n  X  n  nonnegative  matrix  A,  the  following  bounds 


n  n 

min  <E  A{j }  <  p(A)  <  max{y^  .4 tj } 

j=i  1  j= l 

hold  true  for  its  spectral  radius.  Since  the  matrix  A  is  stochastic,  each  one  of  its  rows  sum  to 
1,  whence  p{A)  —  1.  Therefore  by  Theorem  A. 10  there  exists  a  row  vector  x  >  0  with  xA  =  x. 
Normalizing  x  gives  w  =  (a;en)-1  x  with  irA  =  i r  and  7re„  =  1,  i.e.,  7r  is  an  invariant  probability 
vector  of  the  chain.  n 
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Although  Theorem  A.  11  guarantees  the  existence  of  an  invariant  probability  vector,  it  is  not 
unique  in  general.  The  next  result  gives  the  general  form  of  an  invariant  probability  vector. 

Theorem  A.  13.  Let  Si,  1  <  i  <  r,  be  the  ergodic  classes  of  a  finite  state  Markov  chain.  For 
each  Si  there  is  a  unique  invariant  probability  vector  7r(i)  with  the  property  that  the  entries  of  ir(i) 
corresponding  to  the  states  of  Sj  are  positive  whereas  all  other  entries  are  zero.  Moreover,  any 
invariant  probability  vector  n  of  the  chain  can  be  expressed  as  a  linear  convex  combination  of  the 
vectors  i r(i),  1  <  t  <  r,  i.  e., 


r  r 

7T  =  \i  7r(i)  ,  A;  >  0  ,  ^  Xi  =  1  . 

i— 1  i= 1 

Proof.  See  Berman  and  Plemnons  [3,  pp.  224-225]. 

In  view  of  Theorem  A.  13,  even  when  the  Markov  chain  is  not  irreducible,  if  it  has  a  single 
ergodic  class,  then  the  invariant  probability  vector  is  unique  with  positive  entries  for  positions  cor¬ 
responding  to  the  ergodic  class  and  zero  entries  for  positions  corresponding  to  the  transient  states. 
Note  that  the  ergodic  classes  are  defined  as  equivalence  classes  induced  by  the  communication  rela¬ 
tion  as  defined  above,  with  no  assumptions  made  on  the  periodicity  of  the  Markov  chain.  Therefore, 
in  cases  where  there  is  a  single  ergodic  class,  the  unique  invariant  probability  vector  will  coincide 
with  the  long-run  average  probability  vector  of  the  Markov  chain  (defined  in  the  Cesaro  sense). 
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